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. Abstract Topological feedback entropy (TFE) was introduced in 2004 to measure 

^ the intrinsic rate at which a continuous, fully observed, deterministic control system 

generates information for controlled set-invariance. In this paper, we generalise this 
notion in two directions, first to continuous, partially observed systems and then to 
fvq . discontinuous, fully observed systems. In each case, we show that the corresponding 

generalised TFE coincides with the the smallest feedback bit rate that allows a form 
. of controlled invariance to be achieved. 

Q ■ Keywords Topological entropy • communication-limited control • quantised systems 

•S: 

1 Introduction 

In 1965, Adler, Konheim and McAndrew introduced topological entropy as a measure 
of the the fastest rate at which a continuous, discrete-time, dynamical system in a 
1 compact space generates initial-state information [1]. Though related to the older, 

measure-theoretic notion of Kolmogorov-Sinai entropy (see e.g. O), it is a purely 
deterministic notion and imposes only a topology on the state space, not an invariant 
measure. Subsequently, Bowen Q proposed an alternative, metric-based definition 
of topological entropy that is equivalent to the original definition on compact spaces, 
but can also accommodate uniformly continuous dynamics on noncompact spaces. 

These concepts play an important role in dynamical systems but remained largely 
neglected in control theory. However, the emergence of digitally networked control 
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systems (see e.g. Q) over the last four decades renewed interest in the information 
theory of feedback, and in 2004 the techniques of Adler et al. were adapted to in- 
troduce the notion of topological feedback entropy (TFE) [10|. Unlike topological 
entropy, TFE quantifies the slowest rate at which a continuous, deterministic, discrete- 
time dynamical system with inputs (i.e. a control plant) generates information, with 
states confined in a specified compact set. Equivalently, it describes the rate at which 
the plant generates information relevant to the control objective of set-invariance. 

From an engineering perspective, the operational significance of TFE arises from 
the fact that it coincides exactly with the smallest average bit-rate between the plant 
and controller that allows set invariance to be achieved. In other words, if an errorless 
digital channel with limited bit rate R connects the plant sensor to the controller, then 
a coder, controller and decoder that achieve set invariance can be constructed if and 
almost only if R exceeds the TFE of the plantQ Thus set invariance is possible if 
and almost only if the digital channel can transport information faster than the plant 
generates it. 

Subsequently, the notion of invariance entropy was defined for continuous, deter- 
ministic control systems in continuous time [46.7], based on the metric-space tech- 
niques of Bowen. This measures the smallest growth rate of the number of open-loop 
control functions needed to confine the states within an arbitrarily small distance from 
a given compact set. In contrast, TFE is defined in a topological space and counts the 
minimum rate at which initial state uncertainty sets are refined, with states confined 
to a given compact set. Despite these significant conceptual differences, it has been 
established that TFE and invariance entropy are essentially the same object. 

A limitation of the formulations above of entropy for control systems is their 
restriction to plants with fully observed states and continuous dynamics. This makes 
them inapplicable when only a function of the state can be measured or the plant 
has discontinuities such as a quantised internal feedback loop. The recent article Q 
studied continuous, partially observed plants in continuous time, with the objective 
being to keep the plant outputs arbitrarily close to a given compact set for any initial 
state in another set. The notion of output invariance entropy was introduced as a lower 
bound on the required data rate. However, the control functions in this formulation 
are chosen according to the initial state. Thus when the controller only has access to 
the output not the state, the lower bound may be loose. 

With respect to discontinuous systems, notions of topological entropy have been 
proposed for piecewise continuous, piecewise monotone (PCPM) maps on an interval 
(9]|8), using a Bowen-style metric approach. It is shown that the topological entropy 
of a PCPM map coincides with the exponential growth rate of the number of subinter- 
vals on which the iteration of the map is continuous and monotone. In ifTTI . a metric 
approach was also adopted to define a topological entropy for a possibly discontinu- 
ous, open-loop, discrete-time system driven by a sequence of disturbances. However, 
it is not clear how these constructions can be adapted to feedback control systems 
with vector-valued states. 



1 W.l.o.g, there can also be an errorless digital channel from the controller to the plant actuator; in this 
case R is taken to be the minimum of the two channel rates. 
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In this paper we use open-set techniques to extend TFE in two directions, first to 
continuous plants with continuous, partial observations in sec. [2] and then in sec.[3]to 
a class of discontinuous plants with full state observations. In each case, we show that 
the extended TFE coincides with the the smallest average bit-rate between the plant 
and controller that allows weak invariance to be achieved, thus giving these concepts 
operational relevance in communication-limited control. 

Though both generalisations involve open covers, the assumptions and techniques 
underlying them are significantly different. The questions of how to compute bounds 
on these notions and how to construct a unified notion of feedback entropy for dis- 
continuous, partially observed systems are ongoing areas of research. 

Terminology: The nonnegative integers are denoted by Zq and the positive inte- 
gers by N. Sequence segments (x s , . . . ,x t ) are denoted by x* s . A collection a of open 
sets in a topological space Z is called an open cover of a set W C Z if LUeaA Dff.A 
subcollection j3 C a is called a subcover of W if U Be pB D W. If a contains at least 
one finite subcover of W then N(a\W) G N denotes the minimal cardinality over them 
all; in the case where W = Z, the second argument will be dropped. 



2 Continuous, Partially Observed Systems 

In this section, we extend topological feedback entropy (TFE) to continuous, partially 
observed, discrete-time control systems. We then prove that the TFE coincides with 
the smallest average feedback bit-rate that allows a form of controlled set-invariance 
to be achieved via a digital channel. 



2. 1 Weak Topological Feedback Entropy 



To improve readability, most of the proofs in this subsection are deferred to the Ap- 
pendix. Let X be a compact topological space and consider the continuous, partially 
observed, discrete-time control system 

x k +i =/(**,«*) 

, VfceZo, (2.1) 

y* = 8 fa) 6 Y 



where the input is taken from a set U , the output lies in a topological space Y, and 
the functions g and /(•,«), u S U, are continuous. For simplicity write /„(•) :=/(•, m), 
/ s-i := /» ! _ 1 /» ! _2 ' " /»o an d f° r anv s e ^> l et S u s - 1 denote the continuous function 
that maps xq to y s when the plant is fed with input sequence u s Q . Given a compact 
target set K C X with nonempty interior, assume the following: 

(Ob) The plant is uniformly controlled observable: there exists s G Zq and an input 
sequence Vq _1 such that the map g is continuously invertible on g*-\ (X). 
(WCI) The set K is weakly controlled invariant: there exists t £ N such that for any 
xq 6 X there exists a sequence {#jfc(*o)}i=o of inputs in £/ that ensures x t G int/T. 



4 



R. Hagihara, G.N. Nair 



Condition (Ob) states that there is a fixed input sequence v^ 1 that allows the 
initial state xq to be recovered as a continuous function of the output sequence y s . 
The states x\,... ,x s are not required to lie inside intK; this gives the freedom to trade 
transient control performance off for improved accuracy in state estimation. Note that 
(Ob) is satisfied by all observable linear time-invariant plants. 

We also remark that the main difference between WCI and the usual definition of 
controlled set-invariance is that the state only needs to be steerable to the target set 
in t time steps, not one. As a technicality, the topological methods we employ also 
require the state x t to lie in the interior of K. 

We now introduce tools to describe the information generation rate. Pick s £ Zq 
and an input sequence Vq _1 . Let a be an open cover of g^-i (X) C Y s+l , x a positive 

integer, and G = {G k : OC — > U Y k Z Q a sequence of x maps that assign input values to 
each element of a. Define c £ to be the set of all tuples (s,Vg _1 ,a,T,G) that satisfy 
the following constraint: 

(C) For any A G a and xq G g~L\ (A), the concatenated input sequence (vq _1 ,G(A)) 
yields x s+T G intK, with g^-i continuously invertible on g^-\ (X). 

Proposition 2.1 If (Ob) and (WCI) hold then ^ 0, i.e. constraint ( C) is feasible. 

Next, we use a to track the orbits of the initial states. Divide time up into cycles 
of duration s + x and apply an input sequence vT~ 1 that satisfies (Ob) for the first s 
instants of each cycle. Let Aq,A\, . . . be elements of a and for each j 6 N define 

*i(s+r) e g~\ i (Ai) , < i < j - 1 , and 



In other words, Bj is the set of initial states such that during the (i + l)th cycle, the 



sequence y '-\ S ~\ X 2 +S of the first 5+1 outputs lies inside A,- when the sequence of s + x 



inputs over the cycle is (vq 1 ,G(A j )) G U s+t , for every i G [0, . . . ,j — 1], 

Proposition 2.2 The set Bj has the following properties. 

i. Each Bj is an open set. 
it Every xq G X must lie in some Bj. 

Corollary 2.1 For each j G N the collection of sets Bj, 

p J :={B j :A Q ,A u ...,A j - l ea}, (2.3) 

is an open cover ofX. 

Now, since j3 ; is an open cover of X, compactness implies that it must contain a 
finite subcover. Consider a minimal subcover, with cardinality N(j5j) G N. As no set 
in this minimal subcover of j3 7 is contained in a union of other sets, each carries new 
information. Thus as N(fij) increases, the amount of information gained about the 
initial state grows. In order to measure the asymptotic rate of information generation, 
we need the following: 
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Lemma 2.1 The sequence (log 2 Af(/3y))°° =1 is subadditive. 

By Fekete's lemma, the next proposition follows; see, e.g., Ifl2l Theorem 4.9] for a 
proof. 

Proposition 2.3 The following limit exists and equals the right hand infimum: 

Km jgfam = inf jgfcm. (2 . 4) 

We can now define a topological feedback entropy for continuous, partially ob- 
served plants: 

Definition 2.1 The weak topological feedback entropy (WTFE) of the plant ( 12. Il l 
with target set A' is defined as 

«w := mf hm — ^- = inf — (2.5) 

(j,vS~ 1 ,a,T,G)eW->" + ( S ,vJ- 1 ,a,G,T)e^JeN A^ + t) 

where ^ is the set of all tuples fi, Mq~' , a, G, t) that satisfy constraint (C). 



This definition reduces to the weak invariance TFE of [ 10 1 if the plant is fully ob- 
served, since in that case condition (Ob) is trivially satisfied with s = and g s -i = g 
reducing to the identity map. Like classical topological entropy for dynamical sys- 
tems [1], it measures the rate at which initial state uncertainty sets are refined as 
more and more observations are taken 'via' an open cover. The differences here are 
that control inputs must be accommodated, only partial state observations are possi- 
ble, and the slowest rate is of interest, not the fastest. 

Instead of 'pulling back' and intersecting the open sets Aq,A\, . . . G a to form an 
open cover J3y of the initial state space X, suppose we simply counted the smallest 
cardinality of minimal subcovers of the open cover a itself, under constraint (C). It 
turns out that this more direct approach yields the same number: 



Proposition 2.4 The weak topological feedback entropy ( 12.51 ) for the continuous, par- 
tially observed plant ( 12. 1 I ) satisfies the identities 

hw = inf 

sy -\a,T,G s + T 

log 2 N(a\g v ^(X)) 



inf 2 

( s ,vg- 1 ,a,T,G)e^ s + ? 

Proof Note first that by plugging j = 1 into the second equality in ( 12.51 ) we obtain 

fc w = inf kg'* <y < inf igfajW. (2.6) 

(i,vg- 1 ,a,T,G)6«'JeN j[S + V (s,v s Q \a,T,G)e%' s + T 

We prove that the infimum (with 7 = 1) arbitrarily close to /?w can be achieved. 
The definition of the WTFE, combined with the fact that limy-^ j/ (j — 1) = 1 and 
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Proposition 12.31 implies that given e > we can find a tuple (s,Vq , tt,G, t) that 
satisfies constraint (C) and a large j 6 N such that 

log 2 AT(ft) _ log 2 AT(ft) ; 

We now construct a new tuple (V, v'q -1 , a', t', G'). Let s' and v'q -1 be s and Vq _1 
chosen above. The open cover a' of g ^-i (Z) in Y s+1 is obtained as follows. Recall 

that [5j is an open cover of X. We use the continuous map g~_j to form a collection of 

open sets in g^-i (X), {g^-i (By) : By € /3y}. Note that the union of sets g^-i (Bj) is 

gyt-i (X). Since g^-i (X) is equipped with the subspace topology of Y s+1 , each open 

rs+l c „ tU ot „-i 



set g v i-i (By) in g^-\ (X) can be expanded to an open set B'j in Y s+1 so that g s i, maps 
points in B'flg j-i (X) into By. Now a' = {B'- : By G j3y} is an open cover of g s -i (X) 

J Vq J Vq 

in F s+1 . Recall that each By € J3y is of the form 



* ; = ^-i (4>) n 4>g{ Ao) 8^ (A i ) n tf^ ^1, (A 2 ) H 

f\— t rf 

- G(Ao) ■ ■ ■ Sf 'G(A y 



with Aq, . . . ,A,_i in a. Set t' = (/' — 1)(j + t) — s and define a sequence of %' maps G' 
by G'(B'j) = G(A )v^ 1 G(A 1 )...v^ 1 G(Ay_ 2 )- Since (j,v^ _1 ,a,T,G) satisfies con- 
straint (C), by construction (s',v'o _1 ,a',T',G') satisfies (C). Clearly, AT(j8{) =N(J3j), 
where J3{ = g"J_ t (a'), and from inequalities in (I2.7l i we have 

log 2 JV(j3,') , 
s' + t' 

Since £ > was arbitrary, the above inequalities and the earlier result in ( 12.6b give 
the first equality. 

For the second equality, observe that given any tuple (s,vfT 1 ,Gl,T,G) satisfying 

constraint (C) we have iVQBi) = N(Pi\X) = N(a\g,-i (X)), where J3i = g~L(a), 

o v 

since a is an open cover of g^-i (X) in F s+ , g^-i (X) is equipped with the subspace 
topology of Y s+l , and g s -\ is a homeomorphism from the compact space X onto 
g v s-i (X). Thus we obtain the desired equation. □ 

The first equality in this result is a technical simplification that allows the cycle 
index j £ N in the definition of WTFE to be restricted to the value 1 . The second 
equality follows almost immediately but is conceptually more significant. In rough 
terms, it states that under constraint (C), the smallest growth rate of the number of 
'topologically distinguishable' output sequences in g vS -i(X) C Y s+ coincides with 
the smallest growth rate of the number of such initial states in X. 
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2.2 Data-Rate-Limited Weak Invariance 

The weak topological feedback entropy (WTFE) constructed in the previous subsec- 
tion is defined in abstract terms. We now show its relevance to the problem of feed- 
back control via a channel with finite bit-rate, for a general class of coding and control 
laws. 

Suppose that the sensor that measures the outputs of the plant ( 12. U transmits 
one discrete-valued symbol Sk per sampling interval to the controller over a digital 
channel. Each symbol transmitted by the coder may potentially depend on all past 
and present outputs and past symbols, 

Sk = fc({yi}L>.{*}£o ) e S k> ^ k e Z o, (2.8) 

where Sk is a coding alphabet Sk of time-varying size ji^ and Jk '■ Y k+l x Sq x ■ • • x 
Sk- i — > Sk is the coder map at time k. Assuming that the digital channel is errorless, 
at time k the controller has so,...,Sk available and generates 

uk = 8 k {{s i } k i=0 )eU,VkeZo, (2.9) 

where 8k : So X • • • xSk U is the controller map at time k. Define the coder- controller 
as the triple (S,y,S) := {{S k } keZo , {7k} keZo , {Sk} ke z ) ° f the alphabet, coder and 
controller sequences. 

Suppose that the performance objective of the coder-controller is to render K 
weakly invariant, i.e. to ensure that there exists a time q G N such that for any xq G X, 
x q G int/T. Let Q w C M be the set of all the invariance times q of a given coder- 
controller that achieves this objective. For each q G Q w , a ^-periodic coder-controller 
extension that ensures x q ,X7 q , ... G int/T can be constructed, by 'resetting the clock' 
to zero at times ^ , ,2q , ,...|3 The average transmission data rate of each ^-periodic 
extension is simply ~ Lj=o 1°S2 M;> an d me (smallest) average data rate required by 
the coder-controller is then 

j 9-1 

R := inf - Y log 2 /i, (bits/sample). (2.10) 

<?Ggw q p 

We remark that in iflOll . the communication requirements of the coder-controller 
were measured instead by the asymptotic average data rate, i.e. over all j G Zo, and 
the weak-invariance control objective was to ensure x q ,X2q, ■ ■ ■ G intK. Thus for that 
coder-controller, gZo C Q w , and applying (12.10b to it would yield a less conservative 
number. 

The main result of this subsection follows. 

Theorem 2.1 Consider the continuous, partially observed, discrete-time plant ( 12. 1 P . 
Suppose that the uniformly controlled observability ( Ob) and weak controlled invari- 
ance (WCI) conditions hold for a given target set K. 



2 See sec. in in fTOl. 
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For K to be made weakly invariant by a coder-controller of the form ( I2.<SI ) and 
( 12.91 ), the feedback data rate R ( 12.701 ) cannot be less than the weak topological feed- 
back entropy: 



Furthermore, this lower bound is tight: there exist coder-controllers that achieve 
weak invariance at data rates arbitrarily close to /z w . 

This theorem says that weak invariance can be achieved by some coder-controller 
if and (almost) only if the available data rate exceeds the WTFE of the plant on the 
target set. This gives operational significance to WTFE and justifies its intepretation 
as the rate at which the plant generates information for weak-invariance. 

The remainder of this subsection comprises the proof of this result. 

Necessity of the Lower Bound. Let the coder-controller (S, y, 5) achieve invariance 
with data rate R. By ( 12.101 ), Ve > there exists q £ Qw such that x q 6 int/f for any 
xq £ X and 



Let (S , y , 8 ) be the g-periodic extension, which achieves weak invariance at times 
q,2q,.... 

We wish to transform this periodic coder-controller into another that more closely 
matches the structure of a WTFE quintuple, and has nearly the same data rate. Specif- 
ically, we seek a periodic coder-controller each cycle of which has two phases. The 
first phase is an initial 'observation' phase, during which the controller applies a pre- 
agreed input sequence so as to enable the coder to determines the exact value of the 
current state. This is followed by an 'action' phase, where the current state value is 
used to generate symbols and controls so as to achieve weak invariance by the end of 
the cycle. 

Let jgN and the input sequence Vq -1 satisfy condition (Ob). Set T = q and con- 
struct a (s + r)-periodic coder-controller (S 2 , y 2 , S 2 ) as follows; to simplify notation, 
the coding and control laws are defined only for the first cycle. First, the controller ap- 
plies the input sequence u^ 1 — Vq _1 ; during this time, the coder transmits an 'empty' 
symbol. For the remainder of the cycle, i.e. s<k<s + T — 1, the coder-controller 
implements (S 1 , y 1 , 5 1 ) and obtains a new state x s +% £ int/f . This can be achieved by 
defining the coder-controller (S 2 , y 2 , 8 2 ) via 



R>h 



J 9-1 

~£log 2 jU*<i? + £- 



(2.11) 
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Observe that the symbol sequence iJ +T_1 is completely determined by x s via a 
fixed map that incorporates both coder and controller laws. Thus there exist maps F 
and A such that 

s\ +T - x =r(x s ), 

(2.12) 



U 



J+T-l _ A (-S+T-1 



Now consider the disjoint coding regions F (Cj +T l ),c s s +T 1 G x • • • x S^ +t _ l . 
The total number of distinct symbol sequences is IlS - ' rtfc-s = TllZo Mfc> which must 
be greater than or equal to the number n of distinct coding regions. Denote these cod- 
ing regions by C 1 , . . . ,C" and note that f,-\ (X) C U" =1 C ! . We can now rewrite the 
control law in ( 12.121 ) as 



u 



S+T ~ 1 = A*(C) if x, GC\ (2.13) 



where 4 * (C) = 4 (c* +T - ') iff C — r _1 (c* +T - 1 ) . 

We now construct the open cover a of g^-i (X) and the mapping sequence G = 

{Gk : a — >■ £/ }^Z Q required in the definition of the WTFE. To define a, first construct 
an open cover of X as follows. Observe that for any x s in region C, 

where the left hand side denotes f u s+t-i with the control law ( 12.13b . By the continuity 
of f u (hence of < P^*(ri\) an d the openness of intJT, it then follows that for any x s € C 
there is an open set 0(x s ) that contains x s and is such that 

We can construct for each is [1 , . . . , n] an open set D' = U Ti£C , 0(x s ) so that 

which is equivalent to 

^* (ci) (D'')cint*r. 

We then use the continuous map h s -\ = f v s-ig j-i t0 form the collection {h~\ (-D')}i=i 
of open sets in g vJ - 1 (X ) . As g^- 1 (X ) is equipped with the subspace topology of Y s+ 1 , 
each open set h~Z_ 1 (D l ) in g iS -i (X) can be expanded to an open set L in Y s+l so that 
/i v s-i maps points in L' Dg^i (X) into D'. The open cover a for g yS -i (X) is defined 
by a = {L l , . . . ,L"}. Finally, construct the mapping sequence G on a by 

G k {V ) = the kth element of A * (C ' ) for each L ' G a and < k < T - 1 . 

It is evident that constraint (C) on s, , OC, T, G is satisfied. 



10 



R. Hagihara, G.N. Nair 



The minimum cardinality N(cc\g^-i (X)) of subcovers of a does not exceed the 
number n of sets L' in a. From this we obtain 



l 0g2 N(a\ 8vS - t (x)) 

w 



hw = inf 

S y n - l ,a,T,G s + T 



log 2 N(a\ gvSl (X)) 
< 2 



< 



S + T 

l0g2" 
S + X 



From (I2.11l i the last term of the right hand side is less than R + e, since %~q. Hence 
R > /i W . 



Achievability of the Lower Bound To prove that a data rate arbitrarily close to /i\y 
can be achieved, we show that any tuple (s, Vq , a, T, G) that satisfies constraint (C) 
yields an (s + r)-periodic coder-controller that renders K weakly invariant every cy- 
cle. 

Let 

log 2 N(a\ gvSl (X)) 

H:= 2 . 

s + X 

Recalling that a is an open cover of the compact set g^-i (X), select a minimal sub- 
cover of a and denote it by {A , . . . ,A'"}, where m = N(a\g v ,-t {X)). Since g s -i 
is a homeomorphism from X onto g v ,-i (X) and g^-\ (X) is equipped with the sub- 
space topology of Y s+1 , we see that (A')}™ =1 is a finite open cover of X. We 

construct an (s + r)-periodic coding law using these overlapping sets as follows. For 
each k £ [0,s + T — 1], set 5* = {1, . . . ,m} if k = s and = {1} otherwise. Then let 

(unnii-.xoeg-^iA 1 )} if k = s 
s k =< v o . (2.14) 

[ 1 otherwise 

The coding alphabet is of size jU# = m when k = s and 1 otherwise. 

The next step is to construct the controller from the input sequence vjJp 1 and 
mapping sequence G. For the first s instants of the cycle, the controller applies inputs 

Mq -1 = Vq _1 . At time s, the coder determines the initial state xq = gZ^iiy^)- Upon 

v 

receiving the symbol s s that indexes an open set (A') containing xq, the controller 

applies control inputs via the rule m* +t1 = G(A'). 

The coder-controller thus constructed has period s + T. By constraint (C) we have 
Xs+x £ intiT, hence weak (s + r)-invariance is achieved. 
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By (I2.14l i. the average data rate over the cycle is 

- log 2 m l og 2 N(a\g vSl (X)) 

R = —22— = 8 = h. 

S + T S + T 

As /iw is the infimum of H, for any e > we can find (s,VQ _1 ,a,T,G) yielding 
H < /iw + £■ Hence R < /zw + £■ The result follows by observing that R < R by 
definition ( 12.101 ) and then choosing e arbitrarily small. 



3 Piecewise Continuous, Fully Observed Plants 

In this section we introduce the notion of robust weak topological feedback entropy 
for a class of piecewise continuous, fully observed plants. We then establish the rele- 
vance of this notion for bit-rate limited control. 



3.1 Robust Weak Topological Feedback Entropy 

As before, let X be a topological space. We consider the fully observed, piecewise 
continuous plant 

*k+i =F(x k ,u k ) eX, V&eZrj, (3.1) 

where the input u k is taken from a set U . For simplicity write f !( :=F(-,u) and Fj, := 
F Uk ■ ■ -F uo . Assume that there exists a finite partition of X and that each connected 
component of any element of is assumed to have nonempty interior. For each 
u Ell the map F„ is continuous on each element of i.e. F„ is piecewise continuous. 

Let K be a compact target set with nonempty interior, and impose the following 
condition on the plant: 

(RWI) The compact set K can be made robustly weakly controlled invariant under F: 
there exists t 6 N such that for any x EX, there exists an open set 0(x) containing 
x and an input sequence Kin in U that ensures x t G intK' for any xq g 0(x). 

Note that this is stricter than the weak controlled invariance (WCI) condition in 
the previous section. It restricts our focus to plants with states that can be driven 
in finite time into the interior of K, despite an arbitrarily small error in the initial 
state measurement. This requirement is not satisfied by all discontinuous plants, but 
is reasonable if for instance the plant consists of an underlying continuous system 
with an 'inner' quantised control loop and an 'outer' control loop to be designed, i.e. 
F(x,u) = f(x,w,u), where the inner control input w is a quantised function of x. It 
can be shown that if / is continuous and K is WCI, then it is always possible to find 
a sequence of quantised joint inputs (w,u) = (qi (x),q2(x)) that preserves WCI in the 
presence of small state measurement errors. Condition (RWI) then applies if the inner 
loop control law is chosen to be such a robust law q\ (x). For reasons of space, details 
are omitted. 

We now introduce a feedback entropy concept for this system. The key difference 
from Sectionals that the output map g is the identity and so the index s in condition 
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(Ob) there is 0. This leads to taking an open cover a directly on X. We form a triple 
(a, Z, G), where z G N and G = {Gk : a—tU }1Zq is a sequence of z maps that assign 
input variables to all elements of a. Let Sfc'fi be the set of all triples (a,z,G) that 
satisfy the following constraint: 

(RC) For any A G a and xo £ A, the input sequence G(A) yields x T E intK i.e. 

f g^{a) ■■■Fg (a)( a ) CintX". 

Proposition 3.1 If condition (RWI) is assumed, then constraint (RC) is feasible, i.e. 
W ^ 0. 

Proof We give a complete proof to emphasise the difference from the setting in Sec- 
tion[2] cf. Proposition ^. II Assume (RWI). We construct (a,Z,G) that satisfies (RC) 
as follows. Set z equal to t in (RWI). By (RWI), for each x EX there is an open set 
0(x) that contains x and is such that F Ht l ^ . . .F Hq ^(0(x)) C intK. By ranging x in 
X we form an open cover of X, {0(x) : x G X}. The compactness of X implies that 
there exists a finite subcover a = {S{x q )Y q=v Construct the sequence G = {G^IZq 
of Z maps on a by 

G k {0{x q )) = H k (x q ) for each 1 < q < r and < k < z- 1. 

By construction we have that if jc G 0(xi) for some 1 < q < r then 

F G{0(x q ))(x)=F {Hk(xq) y k -^x) £ intK. 

This confirms the feasibility of (RC) under (RWI). □ 

Motivated by Proposition l2.41 we introduce the following concept: 

Definition 3.1 The robust weak topological feedback entropy (RWTFE) of the plant 
(ED is 

/* rw := inf l0g2jV(a) . (3.2) 

(a,%,G)e3K Z 

Unlike TFE and the classical topological entropy, this definition does not involve 
pulling back and intersecting the sets in a to measure the rate at which initial state 
uncertainty sets are refined. Thus it cannot be viewed a priori as an index of the rate 
at which the plant generates initial-state information. However, such an interpretation 
becomes plausible due to the results in the next subsection. 



3.2 Robust Weak Invariance Under a Data-Rate Constraint 

We now show the relevance of robust weak topological entropy to the problem of 
feedback control via a channel with finite bit-rate. 

Consider the fully observed, piecewise continuous plant (13. U . We now introduce 
a feedback loop with a coder-controller of the general form (12.81 l- (12.91 l, but with the 
outputs yi replaced by states X(. The performance objective of the coder-controller 
is to render K robustly weakly invariant, that is, to ensure that 3q G N such that 



Topological Feedback Entropy Extensions 



13 



Vxo G X, there is an open neighbourhood 0(xq) 3 xq such that the input sequence 

uk generated by the coder-controller (S, y, 8) acting on xq ensures F q -\ (x) G mtK, 

"o 

Vx G 0(xq). In other words, we desire that the control inputs generated by ( 12.8b - 
d2.9t for a plant with nominal initial state xq should still succeed in achieving weak 
g-invariance if the true initial state x is sufficiently close. 

Let grw Q N be the set of all the robust weak invariance times q of a given coder- 
controller that achieves this objective. For each q G (2rw> we can construct a ^-periodic 
coder-controller extension, by 'resetting the clock' to zero at times g,2<7,...0 As 
before, the (smallest) average data rate required by the coder-controller is then 

,9-1 

R:= inf -£log 2 M;. (3.3) 

The main result of this subsection follows: 

Theorem 3.1 Consider the piecewise continuous, fully observed plant ( 15.71 ) with a 
compact target set K having nonempty interior. Assume that initial states are in some 
compact set K CX with nonempty interior. Suppose that the robust weak invariance 
condition (RWI) holds on F,K,U. 

For K to be made robustly weakly invariant by a coder-controller of the form 
(H3 _ (H3. the feedback data rate R in ( 13.3D cannot be less than the robust weak 
topological feedback entropy ( 15.21 ): 

R > h m . 

Furthermore, this lower bound is tight: there exist coder-controllers that achieve ro- 
bust weak invariance at data rates arbitrarily close to h^. 

The rest of this subsection consists of the proof of this result. 

Necessity of the Lower Bound. Pick an arbitrarily small e > 0. Given a coder-controller 
(5,7,5) that achieves robust weak invariance, there exists a robust weak invariance 
time q G N such that 

j <?-i 

- V log 2 n k <R + e. 

Set T = q and note that the symbol sequence s^~ l is completely determined by the 
initial state Xq, i.e. there exist maps T and A such that 

ul-< s A(4-<). 

Now consider the disjoint regions F _1 (cq _1 ) CX as the symbol sequence Cq _1 
varies over all possible sequences in Sq x • • • x S T - 1 . The total number of distinct 
symbol sequences is n^=o Mfc> an d hence the total number n of distinct coding regions 
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does not exceed it. Denote these coding regions by C C and note that X — 
U" =1 C. We can then rewrite the control equation in (I3.4l i as 

ul~ l =A*(d) if .(oeC (3.5) 

by defining the map A*{C)=A (eg - 1 ) iff C' = r~ 1 (eg - 1 ) . 

We now construct the open cover a and the mapping sequence G={Gk'- a — s- U 
required in the definition of RWTFE. Before we define a, observe that for any x in 
coding region C, 

& A * (ci) {x)emtK', 

where the left hand side denotes the dynamical map F t -i applied with the input 

"o 

sequence ( 13.5b . By robust weak invariance, it then follows that for any xEC there is 
an open set 0(x) that contains x and is such that 

<P A * ( C f) (xq ) G intAT for any jcq G (jc) . 

We can construct for each 1 < i < n an open set L ! = U xGC i<9(x) so that 

<5 4 *(c") ( x o) 6 intK for any xo G L', 

which is equivalent to 

®A*(d)( Li ) CintfT. 

As C ! C L' and X = U" =1 C ! , we have an open cover a — {L l , . . . ,L"} for X. Finally, 
construct the mapping sequence G on a by 

G k {L' ) = the klh element of A * (C) for each D G a and < k < X - 1. 

It is evident that constraint (RC) on (a, T,G) is satisfied. 
By construction we know that N(a) < n and we obtain 

. p log 2 N(a) 
h m := inf — - — — 

< log 2 jV(a) 
x 

K log2" 

.litest = rf log2M ,< R+ , 

Since e was arbitrary, we have the desired result. 
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Achievability of the Lower Bound. To prove that data rate arbitrarily close to /irw can 
be achieved, we first show that any triple (a, T, G) that satisfies constraint (RC) with 
K induces a coder-controller that renders K robustly weakly invariant. Given such a 
triple, define 

H = log 2 jV(a) 

T 

Recalling that a is an open cover of compact sstX, select and denote by {D 1 . . ,D m } 
a minimal subcover of a, where m = N(tt). 

We construct a T-periodic coding law using these overlapping sets via the rule 

{imaU : xo € D 1 } if£ = „ 
1 1 , 0<k< T-l. 

otherwise 

The coding alphabet is of size /i# = m when k = 1 otherwise. 

The next step is to construct the controller from the mapping sequence G. Upon 
receiving the symbol sq = i that indexes an open set D l in the minimal subcover of a, 
containing xo, the controller applies the input sequence 

By assumption (a, T, G) satisfies constraint (RC). From this it is easy to see that K is 
robustly weakly invariant with the coder-controller and T defined above. 
By (13.2b . the average data rate over the cycle is 

- = \og 2 m = log 2 jV(a) H 
X z 

As /J™, is the infimum of H, for any e > we can find (a, T, G) yielding H < /z rw + e. 
Hence R < h m + e. The result follows by observing that R < R by definition ( 13.3b and 
then choosing e arbitrarily small. 



4 Conclusion 

In this paper we used open set techniques to propose two extensions of topological 
feedback entropy (TFE), first to continuous plants with continuous, partial observa- 
tions and then to a class of discontinuous plants with full state observations. In each 
case, we showed that the extended TFE coincides with the the smallest average bit- 
rate between the plant and controller that allows weak invariance to be achieved, thus 
giving these concepts operational meaning in communication-limited control. 

Our focus here has been on formulating these concepts rigorously and showing 
the fundamental limitations they impose on the communication rates needed for con- 
trol. Future work will focus on computing upper and lower bounds on them for vari- 
ous system classes, and on strengthening the weak-invariance objective to controlled 
invariance. 

Another important question left for future work is how to construct a unified 
notion of TFE for discontinuous, partially observed plants. Such a notion would be 
an important step toward a theory of information flows for cooperative nonlinear 
control systems interconnected by digital communication channels. 
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A Proof of Proposition [2J] 

Assume (Ob) and (WCI). Suppose that s and Vq satisfy (Ob). We construct a,T, G that satisfy (C) as 
follows. Set T equal to t in (WCI). For a, we first observe the following. By (WCI), the continuity of 
/„, and openness of vc&K, for any x s £ X there is an open set 0(x s ) in X that contains x s and is such 
that /g t _j ( Vs ) ■ ■ ■ /« (v,) (0O*«)) c intir, By ranging jc, in / v ,_i (X) we obtain an open cover {0(x s ) '■ x s £ 

/;, r ,(x)}of/ vr ,(x)inz. 

We then use the continuous map h ,_i := / r-iglli to form the collection of open sets in g s _i (X), 
(0( x s)) : e / ,-i (X)}. Note that the union of sets h~ l _j (0(x s )) is g ,_i (X). Since g r _i (X) is 
equipped with the subspace topology of Y s+1 , each open set h~}_, (0(x s )) in g s _i (X) can be expanded to 
an open set S'(x s ) in Y s+1 so that h^-i maps points in S' (.*,,) Hg^-i (X) into O(-Vj). Now {S'(x s ) : jCj £ 
/^s-i (X)} is an open cover of g v ,-i (X) in . 

The open cover a of g ,_i (X) in F I+1 is then chosen to be a finite subcover {L 1 , . . . ,Z/} of {£'(*,)}. 

r o 

The existence of a finite subcover is guaranteed by the compactness of g ,_ 1 (X) as the image of the compact 

v o 

set X under the continuous map g s -i. Let jr? be the point in X such that L' 1 = S'(x1), and let 

G k (L q )=H k (x q s ), l<q<r,0<k<T-l. 
By construction we have that if xo 6 then 

V G (tf) fo>) = V {« t (4)}U (xo) 6 fatt 
This confirms the feasibility of (C) under (Ob) and (WCI). 



B Proof of Proposition 12721 

The openness of Bj is easily confirmed by writing it as 

Bj = g-I, (A ) n *c^ )8 ^ (A.) n *^ o) ^ 1 )4 I (*2) n- 

where ^g(a) := /yj-ig^j is a continuous map. 

Since g ,_i is continuous and a is an open cover of g (X) in ¥ s+> , the collection , (A) : A 6 a} 

v "0 v'o 

is an open cover of X. Hence any jco £ X must be in some g~i, (Ao), Ao £ a. Then constraint (C) implies 

that the s + t inputs G(Aq) forces x s+t £ intX - C X. Repeating this process indefinitely, we see that 
for any .vo £ X there is a sequence Aq.Ai . ... of sets in a such that -t,(, +T ) £ g~,-j (A/) when the input 

sequences {"ilS'+i = v u _1 G(A i ) are used. 



C Proof of Lenuna |23] 



For each £ N, the collection fij + k consists of all sets of the form 



Bj+k = 



i(A )n^ ) ^]. I (A 1 )n-n^ 



Topological Feedback Entropy Extensions 



17 



with Aq, . . . ,A; + fc_i ranging over a. Note that the expression inside the square brackets runs over all sets 
in fa, while the expression inside the large parentheses runs over all sets in fa. Constrain {A,}^ to index 
sets in a minimal subcover faj of fa, and {A,}jt"| _1 to those in a minimal subcover fa k of fa. Denote the 
constrained family of sets Bj +k thus formed by $* +k . 

We claim that fa +k is still an open cover forX. To see this, observe that any xq G X must lie in a set 
B'j e faj indexed by some sequence {A,}^ 1 in a. Furthermore, <Pg(A j _ 1 )■■■ ^GfAo) (*o) G int/f C X and 
thus lies in some set B' k in the minimal subcover fa. Hence xq G ^"q^j ■•■ ^<;(A- ])Wfc) anc ^ so Pj+k ' s 
still a cover for X. As there are N(fa) sets in faj, and to each there correspond N(fa) possible sets in fa k , 
the number of distinct elements in fi* +k is less than or equal to N(fa)N(fa). By the definition of minimal 
subcovers we have that for any j.k G N, 

N{fa +k )<N{fa)N(fa). 
Take logarithm with base 2 on each side of the inequality. 
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